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Abstract 

We develop the equilibrium equations for the a model generalizing the 
continuous review (r, q) lost-sales model with constant lead time, multiple 
outstanding orders and unit Poisson demand. Demand rate is allowed to 
depend on inventory level. The model is solved for the case r=2,q=2 as 
well as the general case q=l. An application is given for a system involv- 
ing lateral transshipments. 

Keywords: Inventory, transshipments, Markov processes, multiple orders, 
lost sales 

1 Introduction 

We are motivated by the situation where the rate at which inventory level 
at a store changes depends on the inventory level. Such situations arise for 
example when the amount of product on display affects the rate at which 
it sells, the existence of lateral transshipments in a multiple store system, 
and the situation where a fraction of demand is backordered and the rest 
become lost sales. The reader may see [Urban 20 05 for a survey of models 
with inventory level dependent demand. We are also motivated by the need 
[Bendre and Th orstens on 2008] and Hill 1992] to estimate average inventory 
levels for the usual (r,q) lost sales model with multiple orders outstanding. To 
these ends we develop a model which generalizes the usual continuous review 
(r,q) model with constant lead time and multiple orders outstanding. We then 
derive a system of integral equations for an embedded process, which when 
solved provides the equilibrium distribution of inventory levels for the system. 
Even when customer demand at a store does not depend on inventory level, 
lateral transshipments and partial backlogging can make the effective rate at 
which inventory level changes depend on the level itself. Thus, to obtain costs 
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for such a system, it is useful to be able to compute the average fraction of time 
spent at a given inventory level. 



2 Model 

In this model, we use the phrase inventory level to refer to a state variable I 
which takes integer values. We interpret / > as a retailer's on-hand inven- 
tory (not including pending orders), and I < as units which are committed 
to backorders. We use effective rate to refer to the rate parameter A; of the 
exponential random variable Xi with density function A;e _Ai *. We intepret Xi 
as the amount of time to transition from state / to state I — 1 in the absence of 
outstanding orders. 

Example 1. For a standard lost sales model, we would have A; = A for I > 
and Ao = 0. 

Example 2. Customers at a retailer demand units one at a time with Poisson 
rate A. When I > C > 0, lateral transhipments contribute a Poisson demand 
with rate ft. When K < / < 0, half of the customer demand is backordered and 
the other half are lost sales. When I < K, no more backorders are allowed by 
the retailer. In this situation we have 

A + P ifl>C 
A ifQ<l<C 

§ tfK<l<0 W 
ifl<K 

Replenishment orders for quantity q with constant lead time t are placed 
when the inventory level transitions from r — kq + 1 to r — kq, for k > 0. This is 
equivalent to triggering an order when the net inventory position [Hadley and Whitin 1963 
transitions from r+1 to r. When an order arrives, the inventory level transitions 
from I to I + q. 

Assumption 3. We require that A/ L = for some inventory level II and all 
l<l L . 

With this assumption, the maximum number of orders outstanding at any 
one time is the largest integer Nq such that Nq < r L + 1. 



3 Procedure 

We wish to find the average long run fraction of time a (I) spent in inventory level 
I, and proceed as follows. First, in the spirit of [Johansen and Thorst cnson 2004J , 
we find an embedded Markov process M with states s. State changes in the 
embedded process are triggered when orders arrive or when orders are placed. 
Next we calculate the expected amount of time spent at inventory level I while 
visiting an M state s. Then, the state transition probabilities and equilibrium 



2 



equations of the embedded process M are derived. The equilibrium distribution 
of M and the law of total expectation are then used to find the fraction of time 
spent in an inventory level I. 

4 Embedded process M 

The embedded Markov process M has states s = (I, ti, t 2 , ■ ■ ■ , tjv ) where I is 
inventory level, and the U, with < t\ < t 2 ■ ■ ■ < i./v < r, are the times until 
oustanding orders are due to arrive. We will use fc to indicate a vector of k 
zeros. An M state in which there are k outstanding orders can be denoted by 

s = (1, 0,0, . . . , 0,tjv o -fc+i, • • • ,tjv ) 

= (i,6 N °- k ,t No - k+1 ,...,t No ) 

where I = r — (k — l)q — d with < d < q and < tj < r. 

4.1 M state transitions 

State transitions of M occur when an order is placed or an order arrives. 

Case 1 - No orders outstanding 

There are no orders outstanding when s — (I, N °) with r < I < r + q. The 
state s can only transition to state (r, O^ 0-1 , t). 

Case 2 - k orders outstanding, 1 < k < No 

Let s — (I, Na ~ k , tjv -fc+i, ■ • • ,tN ) be the current M state, with 
r — kq < I < r — (k — l)q. The following can occur : 

1. The next reorder point r — kq is hit in a time t < iiVo-fc+i from now. In 
this case, another order is placed. M transitions to state 

s' = {r - kq,Q Na - k -\t No _ k+1 -t,...,t No -t,r). 

2. The order due to arrive in time tN -k+i arrives before level r — kq is hit. 
Let d with d < I — r + kq be the decrease in inventory level during time 
tNo-k+i- M transitions to 

s' = (I — d + q, No +1 , - tNo-k+1, • • • , tN — ijVo-fc+l) 

resulting in one fewer outstainding orders. 

Case 3 - iVo orders outstanding 

The current state is s = (I, t\, t%, . . . , £jv ) with 
r — N q < II < I < r — (N — l)q. The next order is due to arrive in time t\. 
Since \i L = the inventory level can only decrease by d < I — II during time 
t\. M will transition to a state 

s = (I - d + q,0,t 2 - h, . . . ,t No - ti). 
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Remark 4. A) It is clear that the only M states with N outstanding orders 
are s = (r - (N - l)q,t 1 ,t 2 , . ■ . ,t No -!,T). 

B) When the system hits a reorder point from above, the next M state has 
ijv = t. 

C) When an order arrives, the next M state has tN < t, and t^ g is almost 
surely strictly less than r ( ijv — t requires new order to be placed instantly 
before a pending order arrives). 

4.2 Expected time at inventory levels while in an M state 

Let c(s,l) denote the expected time spent at inventory level I while visiting M 
state s. 

Case 1 - No orders outstanding 

The M state vistited is s — (I', N °) where r < I' < r + q. Only inventory 
levels I with r < I < I' can be hit while in M state s. There are no outstanding 
orders, so if inventory level I is hit, the system remains at level I for an expected 
time So we have for s = (l 1 , N ") with r < V < r + q 

c(sl) = { ^ *r<l<l' (2) 
I otherwise 

Case 2 - k orders outstanding, 1 < k < No 

Let s = (/', N °~ k , fjVo-fe+ii • ■ • j ijv ) be the current M state, with 
r — kq < V < r — (k — l)q. From this state, the system can hit inventory levels 
I with r — kq < I < I'. The time until the next order arrives is tAr _fe + i so the 
expected time spent in level I while in M state s is given by 
h(l', I, ijv -fc+i), where h() is given in the appendix. 

So we have for s = (I', N °~ k , iwo-fc+i, • • • , tN ) with r — kq < V < r — (k — l)q 

c , s n = f h(l',l,t No - k +i) iir-kq<l<V ,^ 
\ otherwise 

Case 3 - N orders outstanding 

The curent state is s = [V , t\, <2, . . . , t^ ) with 
r — N q < II < I' = t — (N — l)q. The next order is due to arrive in time t\. 
Similar to Case 2 we have 



( fc(r-(JV -l)g,Mi) iir-N q<l L < I < I' = r - {N - l)q 
I otherwise 



(4) 
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4.3 M state transition probabilities 

Let p(si,s 2 ) denote the probability mass or probability density of transitioning 
from M state Si to M state s 2 . 

Case 1 - No orders outstanding 

The current M state vistited is s\ — (li,0 N °) where r < h < r + q. Clearly 

/ x J 1 ifs 2 = (r,0 N °- 1 ,T) 
P(^) = ( otherwise (5) 

Case 2 - k orders outstanding, 1 < k < N n 

Let si = N "~ k , tjv _fc+i, . . . ,ijv ) be the current M state, with 
r — kq <l\ <r — (k — l)q. The next order is due to arrive in time ijv -fc+i- We 
saw in section 4.1, case 2, that M will transition to one of 

1. S2 — (r — kq, o Jv o -fe-1 5 tjvo-fe+i — t, . . . , ijv — t, r) , if the inventory level 
decreases by l\ — r + fcg in time t < tjv -fc+i- This occurs with probability 
density f(h,r — kq + 1, t) (see appendix). 

2. S2 = (h - d + q, No ~ k+1 ,t No - k+2 - t No - k +i, ■ ■ ■ ,t No - t No ^ k+1 ) if the 
inventory level decreases in time £jv -fc+i by d with d < l\ — r + kq. This 
occurs with probability mass g(l\, d, £jv -fc+i) (see appendix). 

So p(si, S2) is a mixed discrete continuous distribution, and is given by 
P(si,s 2 ) = 

' f{h,r-kq + l,t) tfs 2 = (r-kq,d N °- k - 1 ,t Na - k+1 ~t,...,t Na ~t,T) 
with t < t No - k+ i 

g(h,d,t No -k+i) if s 2 = (h - d + q,Q Na ~ k+1 ,t Na - k+2 - t No - k +i, ...,t No - t No - k+1 ) 
with d < l\ — r + kq 
otherwise 

(6) 

Case 3 - N orders outstanding 

The current state is s\ — (h,t\,t 2 , . . . ,tjv ) with 
r — Naq < II < h = r — (No — l)q. The next order is due to arrive in time 
t\. Since \i L = 0, this M state will always transition to one with one fewer 
outstanding orders. So we have 

P(si,s 2 ) = 

g(l', d, t No - k+1 ) if s 2 = (V - d + q, 0, t 2 - ti, . . . , t N „ - h) 

with d < I - l L and V = r - (N - l)q (7) 
otherwise 
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5 Equilibrium distribution for embedded pro- 
cess M 



The long-run distribution of the states of the embedded process M will have 
a mixed discrete continuous distribution. It will be convenient to use different 
symbols to represent contributions to the distribution. 

Definition 5. For the embedded process M we define 

A) (Order arrives) y(l,0 N °) for r < I < r + q is the long-run probability mass 
that M transitions to the state (l,0 N °) with no outstanding orders. 

B) (New order placed) y(r, O^ 0-1 , r) is the long-run probability mass that M 
transitions to state (r, N °^ 1 , r). 

C) (New order placed) y(r - (k - l)q, Ar °" fe , t No - k+ i, . • . , tjv„-i, t), 
for 2 < k < No, is the long-run probability density that M 
transitions to state (r — (k — l)q, N °~ k , fjv -fe+i ; • • • , 1 n -i,t). 

D) (Order arrives) y(l, Na ~ k , t No - k+ i, ■ ■ ■ , ijv -i, *JV ), 

for 1 < k < No — 1, r — kq < I < r — (k — l)q and £jv < t , 
is the long-run probability density that M 
transitions to state (I, N °~ k , tjv -fc+i, • ■ • ,tN -\,tN ). 

We see that for fixed t\, . . . , ijv -i) the distribution is continuous for tjv < t 
and discrete at £jv = T - 

We will proceed on a case-by-case basis to write the equilibrium euqations 
for the embedded process M. 

Case 1 - y(l,6 No ) 

M state s = (l,0 N °) , r < I < r + q, can only be hit from states s' = 
(r, N ° ~ 1 , t n ) with ijv < r. We use the transition probabilites from section 
4.3, integrate the continuous contributions and add the discrete contributions 
to obtain 



y(l,0 N °) = V / p((l',0 N °-\t No ),(l,0 N °))y(l',0 N °-\x)dx 
i>=i- g J *=° 

+p((r,0 JV <'- 1 ,r),G,0 Ar ''))y(r,0 Ar <'- 1 ,r) 

= E / T g(i',i' + Q-i,x)y(i',o N °- 1 ,x)dx 

+g(r,r + q-l,T)y(r,d No -\T) 

Case 2 - y(r, 6 N °-\ r) 

M state s = (r.O^ 0-1 ,^ can only be hit from states s' = (l,0 N °) ,r<l< 
r + q. Each of these states transitions to state (r, n °~ 1 ,t) with probability 1, 
so 
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r+q 



y(r,0 N «-\r) = £ y(l',6 N °) 



=r+l 



Case 3 - y(r - (fc - l)g, Ar °- fe , t No - k+1 , . . . , ijv _i, r), for 2 < k < N 

M state a = (r-(k- l)q,0 N °- k 4 t No - k +i, ■ ■ ■ ,tjv -i,T), for 2 < fc < 7V , 
can only be hit from states s' = (I, JVo_fe+1 , t + ijv -fc+i) ■•■,£ + ijv -i) with 
tN -i < T an( i t < t — tjVo-i- This occurs when a new order is placed before an 
outstanding order arrives. Summing and integrating contributions gives 

y{r - (k - l)q, N "-\ t No . k+1 , tjv _i, t) 



r-(/c-2)q 

E 

J'=r-(fc-l)9+l 



£C = 



P ((l', N °- k+1 ,X + t No - k +U- .-,X + tjVo-l), s) 

* y{l', N °- k+1 ,x + ijvo-fe+i, • • • , a: + tjv„-i) 



+ 



p((r-(A : -2)g,0 w »- fc+1 , 

(r — fjvo-i) + tNo-k+i, . . . , (r — tjv -i) + ijVo-2, t), s) 
* j/(r-(fc-2) g ,0 Wo - fe+1 , 

(t - tjVo-l) + £jV -fc+l> • • • j ( r — ijVo-l) + tjVo-2,7") 



r-(fe-2)q 

E 

J'=r-(fc-l)9+l 



x=0 



/(/', r - (fc - l)g + 1, x) * y(l', N °- k+1 ,x + t No -k+i, ...,x + t No -i) 



+ 



dx 



f(r -{k- 2)q, r - {k - l)q + l,r - ijv -i) 
* y(r-(fc-2) g ,0 N °- fe+1 , 

(r - tjv -i) + iwo-fe+i, . . . , (r — tjv -i) + ijv -2,T ) 



Case 4- JV °- fe , tjv -fe+i, • • • , *jv -i, tjv„)> for 1 < fc < iV - 2 
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M state s = (I, N °~ k , ijv -fe+i, • • • , ijv -i, t No ), for 1 < fc < JVo - 2, t Wo < r 
and r—kq < I < r—(k—l)q, can only be hit from M states s' — (I', N °~ k ~ 1 ,t, t+ 
tN -k+i,- --,t + t No -i,t + t Na ), with l-q<l'<r-kq and < t < r - t Na . 
This occurs when the order pending arrival in time t arrives before the inventory 
level decreases to the next reorder point at r — (fc + l)q. As above, summing 
and integrating contributions gives 

y(l,0 Na ~ k ,t No ^ k+1 , . . . ,ijv _i,tjv ) 



g« r *-o f 

P ((l', N °- k -\t, t + ijv -fe+l, • • ■ , t + t No - U t + t No ),s) 
* y(l',d No ~ k - 1 ,t,t + t No - k+1 ,...,t + t No - 1 ,t + t No ) 

+ 

p((r - kq, N °- k - 1 ^ ( T - t No ), (r - t No ) + t No - k+1 , ...,(r-t No )+ t No - U r), s) 

* y{r - fc(7,0 Ar ° _fe_1 , (t - tjv ), (r - tjv ) +ijv -fe+i, • ■ • , (r - t No ) +t No ^ l7 r) 

g« r , T -t Wo i 
J'=i_, l.^= L 

l' + q-l,t)* y(l', 6 N °- k -\t, t + ijvo-fe+i, • • • , t + tiVo-i, * + *jv ) 

+ 

g(r- kq,r- (k - l)q - I, r - t No ) 

* y(r - kq,^ '^ 1 , (t - t No ), (r - t No ) +t No - k+ - L , . . . , (r - t;v ) +fiv _i,r) 

Case 5 - y(7, O^ ^, t No -k+i, ■ ■ ■ , *jv -i, t No ), for fc = 7V - 1 

These are states of the form s = (I, 0, t 2 , ■ ■ ■ , tN -i 7 t]y ) 7 with ijv < T an d 
r — (No — l)q < I < r — Nq — 2)q. We observed before that there are no M states 
with N outstanding orders with inventory level less that r — (N — l)q. So 
the states s can only be hit (when a pending order arrives) from M states s' = 
(r-(N -l)q, (r-t No ), (T-t No )+t 2 , (r-t No )+t No -i, (T-t No )+t No = t). 
Similar to the previous case we find 

y(l,o,h, ■ ■ ■ ,t No ^i,t No ) 
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p((r- {N - l)q,T- t No ,(r - t No )+t 2 , . . . , (r - tjv ) + *jv -i, r), s) 

* y(r~ (N - l)q,T-t No ,(T-t No )+t 2 ,...,(T-t No )+t No -i,T) 

g(r - (No - l)q, r-(N Q - 2)q -l,T-t No ) 

* I/(r - (N - l)q,T- t No ,(r - t No ) + t 2 , . ■ . , (r - t No ) + t No -i,r) 

Normalization equation 

The above equations have solutions y(), y() and y() which are only unique 
up to a constant multiple. We are concerned with the average fraction of time 
a(l) spent at an inventory level I. Solving the equilibrium equations for M up to 
a constant multiple will suffice for that purpose. For completeness, however, we 
present the normalization equation for the embedded process. By integrating 
contributions from y(), y() and y() over the state space of M we have 



r+q 

E v«f No ) 

i'=r+l 

+ y(r,d N °-\r) 

No-l r-(k-l)q f . f t No _ k+2 

+ E E / / •••/ 

fc=l l=r-kq+l I J *N =0 Jt No -!=0 Jt No -fc+i=0 

y(l, No ,tjv„-fc+l, • • • , tN -l,tff )dtN -k+l ■ ■ ■ dtN 

— 2 { Jtw o -l=0 J t N() -2=0 JtN o -k+l=0 

y(r - (k - l)q,0 N °~ k ,t No - k +i, . . . ,t No - 1 ,T)dt No - k+1 . ..dt Na 
5.1 The equilibrium equations for M 

We have just shown that the equilibrium equations for the embedded process 
are 

1. r < I < r + q 

y(i,o No ) = E / T g(i',i' + <i-i,x)y(i',o N °-\x)dx 

V=l- q J *=* 

+g(r,r + q-l,T)y(r,d N <>-\T) (8) 
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2. 



r+q 



=r+l 



(9) 



3. 2 < k < N 

y(r - (k- l)q, N "~ k , t No - k+1 , . . . , tjv -i,r) 



r-(k-2)q 

E 

;' =r _(fe-i)g+i L 



x=0 



f(l', r-(k-l)q + l,x)* y(l', N °- k+ \x + t No - k+1 , ...,x + t N „^) 



dx 



+ 



f(r -(k- 2)q, r -(k-l)q+l,T- ijv -i) 
* y(r- (k-2)q,0 N °- k+1 , 

(t - tjVo-l) + tjVo-fc+li • ■ • , (t — tjVo-l) + tjV -2,T) 



4. 1 < fc < 7V - 2, ijv < r and r - kq < I < r - (k - l)q 
y(l,0 N °~ k ,t No - k+1 , . . . ,tN -i,tN ) 



(10) 



r—kq 

E 

l>=l-q 



T — tNn 



g(l', l' + q-l,t)* y(l', N °- k -\t, t + ijv -fe+i, • • • , t + t No -i,t + t No ) 



dx 



+ 



g(r -kq,r- (k - l)q -l,T-t No ) 

* y(r - fc(7,0 Ar ° _fe_1 , (t - t No ), (r - t No ) +ijv -fe+i, • • • , (t - t No ) +t No -!,T) 

(11) 



5. t^o < t and r - (N - l)q < I < r - N - 2)q 
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y(Z,0,f2, • • • ,tjVo-i>*Ar ) 



,g(r - (iV - l)g, r - {N - 2)q -l,r-t No ) 

* y(r - {N - l)q,T- t No7 (r - t No ) +t 2 , ■ ■ ■ , (r - tjv ) +tjv -i,T) 

(12) 



6. Normalization 
1 = 



r+q 
J'=r+1 

N -l r-(k-l)q 



V E / / -/ 

y(Z, O^ 0- *, tjv -fc+i, ■ • ■ , tN -i,tN )dtN -k+i ■ ■ ■ dtN 



+ 



k—2 \ JtN -i=0 J tN a -2=0 ^ijv o -fc+i=0 



j/(r - (fc - 1)9,0^° fc ,tAr -fc+i, • • .,t No -i,T)dt No - k+ i . ..dt No -i | 

(13) 

□ 

6 Average fraction of time spent at an inventory 
level 

Let w(l) denote the expected time per M state spent at inventory level I. We 
can compute w(l) using the distribution for the embedded processes M and the 
law of total expectation. After computing w(l), we can compute the average 
fraction of time a(l) spent at inventory level I as 



«(0 = T^TT (14) 



MO 
ESI »(0 

We'll proceed as before and break the situation into cases. 
Case l-r<l<r + q 
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Inventory level I can only be hit in M states s = (l',0 Na ) with I < I' < r + q. 
So applying the law of total expectation gives 

r+q 

w(l) = Y,<(l',0 N °),l)y(l',0 N °) (15) 
i'=i 

Case 2 - r - kq < I < r - (k - l)q for 1 < k < N a - 1 
Level I can only be hit in M states 

1. s = {l',d N °- k ,t No - k+1 ,...,t No - 1 ,t No ) with I < I' < r - (k - l)q and 
tN < T 7 and 

2. s = (r - (k - l)q,6 N «~ k ,t Na ^ k+1 , . . . ,t Na ^,T) 

So the total expected time per M state spent at level I is 



w(l) 



r-^l)g T t „ o rt No - k+2 ( 

li— i Jt N(j =0 ^tjv o -i=0 ^tjv o -fc + i=0 
C ((/',0 Ar °- fc ,t A r o _ fc+1 ,...^ o ),0 

*y(/',0 Ar °- fc ,t A r o _ fc+1 ,...^ o ) 

dtN -k+l ■ ■ ■ dtN 



+ 



tN -l rtN -k + 2 



-2—0 JtN — fc + l=0 ^ 

c((r - (k - 1) 9 , JV °- fc , tjvo-fc+i, • • • tjvo-i, t), I) 
*y(r - (As - l)g, N °~ k ,t No - k+u . . . ijv -i, r) 

dtN -k+i ■ ■ ■ dtN -i } 



(16) 



Case 3 - l L < I < r - (N Q - l)q for 1 < k < N Q - 1 

Level I can only be hit in M states s = (r — (N — l)q, t\, t<i, . . . , ijv -i> T )- 



w(l) 



rr rtN -i rt 2 ( 

itw o -i=0 An -2=0 A 1= [ 



c((r- (AT - l)g,ti,t 2 ,...,tjVo-i,T),0 
*y(r- (7V - l)g,ii,i 2 ,---,ijv -i,T) 



dti . . . rftjv -l J 

(17) 
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7 The case q=l 



In this section we will solve the equilibrium equations for the case q = 1 and find 
a closed form expression for a(l). Referring to the appendix we have f(l, /, x) = 
\ ie -*i x and g(l,0,x) = e~ XlX . To make verifying the solutions more convenient 
(we will leave out these details) , we will rewrite the equilibrium equations of M 

as 

1. Equation OA 



y(r + l,0 No ) = f e- XrX y(r,0 N °- 1 ,x)dx 

+e- x ^y{r,Q N «-\r) (18) 

2. Equation OB 

y{r,Q N °-\T) = y{r + l,Q N °) (19) 

3. Equation OC 

f-T — t 

y(r,0 N °-\t) = / e~ Xr - lX y{r- l,0 No ~ 2 , x,x + t)dx 

Jx=0 

+e- K -^-t)y( r - 1, n °- 2 ,t - t, t) (20) 

4. Equation kB, for 2 < k < N Q - 2 
y(r-(k-l),6 N °- k ,t No - k+1 ,...,t No - 1 ,T) 

rT—tN Q -i 

= / K-{k-2)e- K -^ x 

Jx=0 

*y(r - (k - 2),0 N °- k+1 ,x + t No - k+1 ,x + t No ^)dx 
+\r-(k-2)e~ K - {k - 2){T ~ tNa - l) 

*y(r -(k- 2),6 N °- k+1 , (r - t^-i) + tjv -fc+i, ■ • • , ( T ~ t No -i) + t No - 2 , t) 

(21) 

5. Equation kC, for 2 < k < N - 2 

y(r- (k- l),0 N °- k ,t No - k+1 ,...,t No -i,t No ) 
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rr-t No 
= / e -K- k x 

Jx=Q 

*y(r - k, Wo ~ fc ~ 1 , x, x + t No -k+i,- ..,x + t Na )dx 

_|_g--V-fc(T-*N ) 

*y{r - k, N °~ k ~ 1 ,T- t No , (r - tjv ) + ijv -fc+i, • • • , ( T - tN ) + t N „-i,T) 

(22) 

6. Equation (N - 1)B 

y{r-(No-2),0,t 2 ,...,t No - U T) 



/■T — ZNq-1 

/ A r _ (Wo _ 3) e- A -(«o-3,- 

Jie=0 



*j/(r - (No - 3)),0,0,x + t 2 ,x + t No -i)dx 

*y(r - (N - 3), 0,0, (r - tjv -i) +i 2 , . . . , (r - ijv -i) +ijv -2,r) 

(23) 

7. Equation (AT - 1)C 

y(r - (N - 2), 0,t 2 , ■ ■ . , *jv -i, t No ) 

= y(r - (N - 1),t- t No , (t - t Na ) +t 2 ,...,(T- t No ) +t No -i,T) 

(24) 

8. Equation (N )B 

y(r- (N - l),ti,t 2 ,...,tjv -i,T) 

PT — tN Q -l 

= / A r _ (A r _ 2) e- A -(«o-2 )a; 

Jie=0 

*t/(r - (7V - 2)),0,x + t 1 ,x + t No -i)dx 

*y(r - (No - 2),0, (t - t No -i) +t 1 ,. . . , (r - tjv -i) + *jv -2,t) 

(25) 

It can be verified that the solutions to the above non-normalized equations 

are 
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c 


IT 


-(JVq-2) X i 




C 


if 

1 Li—r- 


-(JVo-2) ^» 




for r — 




C 


n'- 1 

1 Vl—T- 


-(No-2) 




for r — 



SKr + l.ff"") - ^ (26) 



y(r-(N -2),r) = C (29) 
y(r-(N -l),t,r) = C (30) 

Remark: These equilibrium solutions do not depend on the times remaining 
on outstanding orders. 

7.1 Expected time per M state spent at inventory levels / 

From the appendix, we have h(l,l,t) = — e~ Xlt ). Using this, and the 
derivations of c(s,l) we find 

±- \{r<l<V 
i (l_ e -A,t J v _ fc+1 ) \H' = i = r -{k-l) and 1< < -/V - 1 

otherwise 

(31) 

Substitution of the formulas for c(s,l), y(), y() and y() into the equations 
for w(l) found earlier, followed by direct integration and simplification yields 



C_ 

'o 



w(r + l) = (32) 

ll»=r-(JV -2) A * 

w(l) 



(r-l + l)\UUr-(N -2) 

for r - (N a - 3) < I < r (33) 
w (r-(N -2)) = (34) 

[JM - l)!A r _ (A r _2) 

»(r-(JVo-l)) = ^ (35) 

(36) 

With fa = Xi for i > r — (N — 1) and fi r -(N a -i) = 1 these equations can be 
re-written as 
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MD - c^nS^A) (37) 

lli=r-(JV -l) Pi 



Finally, we have 



«(0 = ^tTtT (38) 



MO 
TZl Mi) 

(r-i+l)! riii+1 ( T A) 



Ili=r-(JVo-l) Pi 



^r+1 J (r-j 



Sj=r-(iV -l) TT , '+ 1 



IL=j+l ( T A 



(39) 



Ili=r-(iVo-l) ^i 



^ r+l 
Ejir-(JVo-l) 'j ( r _ ? - + f)j II ( T A) 



(40) 



We notice that the equations do not depend on /3 r _(jv _i). Therefore we can 
write the final formula in terms of Ai : 



r+l 



n (^) 



(r-i + 1)! 

o(i) = — r- (41) 



-(iVo-1) [ 1 - 7 ^ 7 i=j+l J 



□ 



8 Application of the case g = 1 

We consider a system of two stores with continuous review buy-as-sold policies 
(ri, 1 and (r2, 1). Each store has a lateral transshipment cutoff level c n . If a 
store's inventory level is at least c n , outgoing lateral transshipments are allowed 
to the other store. The lateral transshipments take no time. The stores face 
customer demand for one unit at a time, which is Poisson distributed with rates 
7„. If a customer demand arrives when a store has no on-hand inventory, then 
a transshipment from the other store is made if allowed, otherwise the sale is 
lost. 

Let /3i represent the fraction of time store i has no on-hand inventory (1 = 
). The effective rates at which inventory level decreases are given by ( for m ^ n 

) 
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\T={ 7m if 1 < I < c m (42) 



We can compute f3 m = a(0) m from the formulas for the average fraction of 
time spent at inventory level 0. 



P m = a(0) m (43) 

^ r m +l 

n ^ 

(44) 



| Cm-l r m + l 

^yrj n ( rA ™) n T ( x ™+PnK) 



{r m + l)\ 




—max(c m ,j-\-l) 



(45) 



with m ^ n and the convention that an empty product equals 1. This gives 
us two equations in two unknowns. We may solve for (3i and (numerically or 
otherwise) and then compute a(l)i, from which we can obtain the costs (holding 
costs, lost sales penalties, etc.) which are of interest for an inventory system. 

9 The case when r = 2 and q = 2 

We will solve the embedded equilibrium equations for the case when r = 2 
and q = 2, where A = and Aj = A for i > 1. The embedded equilibrium 
equations are tractable in this case. We will be satisfied to solve them up to 
a constant multiple. To ease calculations, we will choose y(2,0,r) = 1. We 
also note that in this case we have (since A = ) g(0, 0, t — t) = 1. Therefore 
y(2,0,t) = y(0, t — t, t) and y(l,0,t) = 0. In addition, from the appendix we 
have f(2,l,x) = \ 2 xe~ Xx . 

Rewrite the equation for y(0, t, r) as 
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y(0,t,-r) = / f{2,l,x)y(2,0,t + x)dx + f(2,l,T-t)y(2,0,T) 

Jx=0 

,T-t 

= / A 2 a;e- A2: y(0,T-t-a ; ,r)rf.T + A 2 (r-t)e- A ( T -*) 



£C = 
/•T-t 

z(t) = / \ 2 {t -t-x)e- x{T - t - x h{x)dx + \ 2 {T -t)e- x{T ^ 

Jx=0 

(46) 

where z(t) = y(0,t, r). By repeatedly differentiating z(i) and substituting 
t = t — t this equation can be reduced to the ordinary differential equation 

= -2 (47) 

The general solution is z(t) = A + Bt + Ce xt ^ + De~ Xt ^. Substituting 
this and solving the resulting equations we can obtain: 



A = l^Z^g ±3+^ (48) 
B = (49) 
C = l ~ r (50) 

D = -l ( - 4 + 3 ^ )Ae ^ (51) 

The values a(Z) can be obtained by direct integration following the procedure 
in section 6. The resulting formulas are complicated and we won't display them 
here. 



10 Appendix 

We review some useful results concerning sums of exponential random variables. 
Throughout this section L refers to the Laplace transform operator with respect 
to time t. 

10.1 Probability density of a sum of exponential random 
variables 

Let {Xi} be a collection of exponential random variables with rates Aj. 
Definition 6. Let Xi lt i 2 — Y^!i=u w ^ ^ — ^- 
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Definition 7. Define f{h,l\,t) to be the probablility density function ofXi ly i 2 . 
Define f(l2,h,s) to be L{f(l2,h,i)}(s), where L is the Laplace transform op- 
erator with respect to t. 

The density function of a sum of variables is a convolution, so the Laplace 
transform becomes 



f(h,h,s) = (52) 

When the A^ are identical, f(h,h,t) is an Erlang density. When all A^ are 
distinct, f(h,li,t) is given by 



\ h e- x ^ iih=h 



,J h ' A, 



mj 1 ,t)=< [ ^2 n ( Xie ~ Xit [Ui>h (53) 

A closed form for f(h, h , t) is known for an arbitrary collection of Ai |Amari and Misra 1997] 

10.2 Probability of decrease in inventory level before an 
order arrives 

Definition 8. Suppose the inventory level is currently I' and an order is due 
to arrive in time t from now, with no orders arriving earlier. Define g{l,d,t) 
to be the probability that the inventory level decreases from I to I — d in time t. 
Define g(l,d, s) = L{g(l,d,t)}(s). 

We have 

{/ Xie- X,x dx if d = 
r t Jx=t (54) 

/ f(l,l-d+l,x)e- Xl - d ^- x ^dx if d > 1 
Jx=0 

and so using the convolution property of the Laplace transform 

' if d = 



!,U.d.s)={ l Xl + S (55) 

n i-b i{d ^ 1 



k-d + s . "~ Ai + s 

1=1 — £1+1 



If all Ai are distinct, direct integration of J^ =0 /(/, I — d + 1, x)e Xl - dl ~ l x )da 
gives the result 
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g{l,d,t) 



A, 



=l-d+l 



n 



A;-i — A; 

A; 



Aj — Aj / \ A;_d — A 



e - Alt if d = 
e - Al * - e - Al - 14 ) if d = 1 

-Ait _ g-Ai-dt-j 



if d > 1 



(56) 



10.3 Expected time spent in an inventory level before an 
order arrives 

Definition 9. Suppose the inventory level is currently V and an order is due 
to arrive in time t from now, with no orders arriving earlier. Let h(l',l,t) be 
the expected time spent in inventory level 1,1 < V during time t. Let h(l', I, s) = 
L{h(l',l,t)}(s). 

A time x is spent in level I when either A) Xyj+i < t — x and Xij = x or 
B) Xi'j+i = t — x and Xij > x. Integrating these contributons gives us 

h{l',l,t)= (x\ie- x,x ) Qf f{l',l + l,s)ds^jdx 

+J f(l',l + l,t-x)(xj Xie- X ' s ds^dx (57) 



h 1 (l',l,t) + h 2 (l',l,t) 



(58) 



h\ and h 2 are convolutions, so we take the Laplace transforms of hi and h 2 
to get 



hi(s) 



h 2 (s) 



n 



s \(Xi + s) 2 J .11 Xi + s 
i=i+i 

n 



( a < + *) 2 ^ + i ^ + s 



(59) 
(60) 



Summing gives the Laplace transform of h 



h{l',l,s) = 



1 



(A; + sY V 8 



n A 



i=i+i 



Xi + s 



n 



s(Xi + s) .A J- A, + s 



(61) 
(62) 
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It can be verified either by applying the inverse transform L 1 to h or by 
integrating the equation for h(l', I, t) directly that (for distinct Aj) h has the form 

h(l',l,t) = 

t , if I = I' and X v = (63) 

-!-(l - e" Ai '*) , if I = I' and X P > (64) 
A;/ 

— !— (1 - e-^'- 1 *) + (- 1 -^)(e- Xl '-^ t - e- A ''* , if I = I' - 1 (65) 

4 n ^ - + <^)(-" - •-*■)} . «« < ^ - 1 

i=!+l i 7=i+l x 

(66) 

Remark 10. Direct numerical calculation using the formulas f, g and h tends 
to explode for distinct Xi when some Xi are close together. Numerical inversion 
of the Laplace transforms f , g and h avoids this problem. 
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